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ABSTRACT 

Evaluation of an ESEA Title III project, "An 
Inter- Disciplinary Problem Solving Approach to Environmental 
Education" located in Berks County, Permsylvania, is offered in this 
interim report. The report is primarily concerned with the degree to 
which operational and management process objectives are being 
achieved in each of four components: instruction, staff development, 
materials development, and comm\inity involvement. Comments are 
directed toward the already completed product objectives as they 
relate to experimental groups at both the fifth- and seventh-grade 
levels. A variety of methods were employed in the analysis procedure: 
student pre- and posttest scores; on-site visits; individual 
discussions; records of project activities; questionnaires; rating 
scales; and reviews of reports submitted by teachers and staff. . 
Summary statements indicate that the project has been extremely 
successful in utilizing its expertise, staffs and facilities; stated 
objectives have teen met at levels consistently above what was 
expected; the environmental knowledge of participating students has 
improved significantly; and students have changed their attitudes 
towards the environment in a more positive direction* . However, 
community development was not proceeding as planned, primarily in 
relation to the creation, continuation, and integration of local and 
central advisory committees. . (BL) 
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L INTRODUCTION 

This is the second in a series of on-going written and oral reports 
submitted by Educational Research and Development Associates (ERANDA) 
to evaluate the Berks County Intermediate Unit's ESEA Title III, (Section 306) 
Project OE 7107229, "An Inter-Disciplinary Problem Solving Approach in 
Environmental Education". Constant oral interchange occurs between the 
Project Director, his staff, and ERANDA in the intervals between formally 
written and submitted reports. 

This interim report will be primarily concerned with the degree to v/hich 
the operational and management process objectives are being achieved in 
each of the four components: instruction, staff development, materials 
development, and community involvement. Comments will be directed 
toward thec.already completed product objectives as they relate to the 
fall experimental groups at both the fifth and sev^enth grade levels. The 
Implementation Report was fav^Orable in most respects. Favorable areas 
in the report have remained favorable and, as such, only those few areas 
receiving unfavorable comments in the report will be addressed herein. 

This report has been prepared aft- 3 thorough examination of the 
objectives utilizing the following: 

1. Analysis of student growth in environmental knowledge and 
attitudinal change in the six 5th grade and five 7th grade fall 
experimental groups. The significance of cognitive growth of the 
experimental groups was determined by a correlated t-test based 
upon students' pre and post test scores on a locally-developed, 
contest- valid examination. Cognitive growth in the experimental 
group was compared, through an analysis of covariance, to that 
of appropriate control groups. The significance of attitudinal 
change in the experimental groups was determined by a correlated 
t-test based upon students' pre and post scores on a locally- 
developed Idkert-type scale. Attitudinal change in the experimental 
group was compared, through an analysis of covariance, to that of 



appropriate control groups'. Adequacy of instruments and 
control groups was discussed in the Implementation Report. 

2. Periodic on-site visits to Nolde Project Headquarters by 
ERANDA. 

3. On-site visits to all fall experimental schools by ERANDA. 

4. Individual discussions with each fall experimental teacher 
by ERANDA. 

5. Review of records of activities of fall experimental schools 
as recorded in teacher's logs by ERANDA. 

6. Final reports on each experimental school program prepared 
by'Nolde Staff. 

7. Record of project activities as recorded in staff logs. 

8. Results of questionnaires submitted to local and central 
community advisory committee, Speakers, control and 
experimental teachers, and students and staff. 

9. Ratings of project teachers, staff and guides by Project Director, 

10. Reports submitted by Director and staff. 

11. Minutes of staff and community advisory council. 

12. Observations of pre and post testing procedures by ERANDA. 

General Comments : The Nolde State Forest Environmental Project has 
consistently produced high quality results with a minimum staff and budget. 
This success is largely due to the efforts of its Director, Mr. louis 
Ritrovato. The addition of a secondary coordinator has made possiiDle an 
extension of the program to the seventh grade level. The introduction of 
environmental education into secondary schools has caused a ripple effect 
to occur already generating interest in individual study programs at the 
senior high level. 

The Center reflects its ability to reach larger and larger numbers of 
school and community persons by its remarkable increase in monthly 
attendance at the Nolde.. site over the first year of operation. The only 
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area of concern still evident is at the local community level and effort 
is being expended to correct this problem. In spite of its growing need 
for more staff, the overall program continues-,tp be not only meeting.its 
objectives but constantly widening and deepening its direction, 

11, EVALUATION OF INSTRUCTIONA L PRODUCT OBJECTIVES 

The Nolde Forest Project, in order to make services available to as latoe a 
population as possible, has sub-divided the school year into three 12-week 
components (fall, winter and spring) with selected experimental schools at 
the fifth and seventh grade levels in each component. The Interim Report 
will include product results from the first component which was completed 
in December. The other two units will be discussed in the Final Report, 

The experimental and control schools were chosen by the Project 
Director so as to be representative of rural, suburban, and urban popula- 
tions within the Project's service area. The control students will serve 
as controls for the winter and spring experimental groups as weli as the 
fall. The student groups were analyzed separately by grade (fifth and 
seventh) and by area (rural, suburban and urban), six groupings in all. 
The analyses included a correlated t-test to determine the statistical 
significance of the growth in environmental knowledge (Table I) and the 
attitudinal change in the students towards a more positive environmental 
attitude (Table II) for each of the six experimental groupings. The experi- 
mental groups were then compared to their respective control groups, using 
an analysis of ccvariance (Tables III - XIV), to determine if growth were 
different than what would be expected if the students had not been involved 
in the project or similar activities. 

Table I indicates that each of the six experimental groupings demonstrated 
statistically significant growth in environmental knowledge at a probability 
level less than .001 . 

*All Tables for the Instructional Product Component follow the discussion. 
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Table II* indicates that each of the six experimental groupings demon- 
strated statistically significant changes in. their expression of a more 
positive attitude towards the environment at probability levels ranging 
from less than ,001 to less than .10 depending upon the grouping. 

Tables III* through VIII* are the results of analyses of covariances 
on each of the six groupings when the growth in the groupings' environmental 
knowledge was compared to its control. 

Tables III* and IV* indicate that cognitive growth in environmental 
knowledge of the experimental urban groups, grades 5 and 7, was 
significantly {p <.001) greater than respective control groups when post 
results were adjusted for beginning differences in the groups. An analysis 
of variance performed on pre test score results gave no reason to believe 
significant differences (o<:= ,05) between the groups at project start. 

Tables V* and VI* indicate that the growth in environmental knowledge 
of the experimental rural groups, grades 5 and 7, v/as significantly (p<.001) 
greater than their respective control groups, after adjustment for beginning 
differences between the groups. An analysis of variance on pre score test 
results showed no reason to believe significant differences .05) between 

the groups at the beginning of the project. 

Table VII* indicates that cognitive growth for the experimental seventh 
qrade suburban group to be significantly (p<.10) greater than its control 
group when post test results were adjusted for beginning differences. An 
analysis of variance performed on the pre test scores showed the experimental 
group possessing more environmental knowledge than its control group at the 
start of the project. However, the analysis of covariance was able to 
adequately adjust for these differences (F-t.est on group regressions was 
not significant) , 

Table VIII* indicates that cognitive growth for the experimental fifth 
grade suburban group, although significant (Table I), was not significantly 
more (p>.25) than its control group when post test scores were adjusted for 

*A11 Tables for the Instructional Product Component follow the discussion. 



beginning differences in. pre test scores. An analysis of variance performed 
on the pre test scores gave no reason to believe significant differences 
.05) existed between the groups at project start. 

Table IX* indicates that attitudinal shift about the environment for the 
experimental fifth grade urban group was significantly (p<. 02) towards a 
more positive attitude than was the shift in its control group, when post 
test results were adjusted for pre test differences , An analysis of variance 
performed on the pre test scores , showed the experimental group possessing 
a more positive attitude towards the environment than its control group at 
the, start of the project. However, the analysis of covariances was able to 
adequately adjust for these differences (F-test on group regressions was not 
significant). 

Table X* indicates that the attitudinal shift about the environment for 
the experimental seventh grade urban group was significantly (p<.001) 
towards a more positive attitude than was the shift in its control group 
after post test results were adjusted to reflect beginning differences in 
attitudes between the groups. An analysis of variance performed on the 
pre test results gave no reason to believe significant differences .05) 
existed between the groups at project start. 

Similarly, Table XI* indicates that the attitudinal shift about the 
environment for the experimental fifth grade suburban group was significantly 
{p<. 05) towards a more positive attitude than its control group. With no 
significant differences .05) in attitude between the two groups being 

found at the start of the project. 

Tables XII* (fifth ^rade rural), XIII* (seventh grade rural) and XIV* 
(seventh grade suburban) indicate that the attitudinal shifts, although 
significant (Table II*), were not significantly more (p>.lS) in a positive 
direction than respective control groups when pest test results were adjusted 
for attitudinal differences between the experimental and control groups at the 
start of the project. Analyses of variance performed on the pre test scores 

All Tables for the Instructional Product Component follow the discussion. 

-5- 



gave no reason to believe significant ,0 5) differences existed between 
the fifth grade rural group and its control, nor the seventh grade rural grouD 
and its control. However, beginning differc^nc^^s did exist between the 
seventh grade suburban group and its control. The experimental group 
exhibited a more positive attimde than its control at the start of the project- 
In this case, the analysis of variance procedure was again able to sufficiently 
adjust for these beginning differences (F-test on group regression coefficients 
was not significant). 

In summary, the experimental studorts at fifth and seventh grade grew 
significantly in their knowledge about the environment and became more 
positive in their attitude toward it. When compared with their respective 
control students, the urban, rural and seventh grade suburban schools 
experienced significantly greater growth in knowledge about tho '-environment 
than did the control groups. The fifth grade suburban schools did not 
experience such a growth. 

A more positive attitudinal change towards the environment was 
experienced by the urban schools and the fifth grade *su bur ban school 
than their respective control groups. This was not the case for the rural 
schools nor the seventh grade experimental school. 

It seems that all the emphasis being currently placed on the environment 
is having its effect. All students seemingly are becoming more positive 
towards the environment; for some project students the attitudinal shift is 
a little larger than other students, in all cases, except the fifth gre 
suburban group, project students are becoming more knowledgeable than if 
they did not participate in the project. This seems to be more true for urban 
students. The urban students seem to be benefiting most from contact with 
the project. 
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Table I 



Change in Environmental Knowledge 
in Pre and Post Testing 
o:: Fall Experimental Students 









Mean 


Mean 




Stand. 


Corr . 




Area 


Grade 


N 


Pre 


Post 


Chg. 


Error 


t 


Proba bility 


Rura 1 


5 


67 


2U.03 


23.67 


3.64 


.69 


5.25 


p<.001 


Suburban 


5 


52 


21 .52 


25.08 


3.56 


.82 


4.32 


p<.001 


Urban 


5 


52 


20.58 


28.40 


7.82 


.64 


12.30 


p<.001 


Rural 


7 


53 


27.45 


32.13 


4.68 


.65 


7.25 


p<.00] 


Suburban 


7 


48 


26.94 


31.98 


5.04 


.83 


6.09 


p<.001 


Urban 


7 


26 


21.04 


28.31 


7.27 


.78 


9.32 


p<.001 



Table II 



Change in Environmental Attitude* 
in Pre and Post Testing 
of Fall Experimental Students 









Mean 


Mean 




Stand. 


Coir. 




Area 


Grade 


N 


Pre 


Post 


Chg. 


Error 


t 




Prob" ;ility 


Rural 


5 


67 


2.68 


2.58 


-.10 


.05 


-2. 


23 


p<.05 


Suburban 


5 


52 


2.51 


2.38 


-.13 


.04 


-3. 


45 


p<.01 


Urban 


5 


52 


2.47 


'2.29 


-.18 


.04 


-4. 


16 


p<.001 


Rural 


7 


53 


2.23 


2, 14 


-.09 


,05 


-1. 


85 


P<. 10 


Suburban 


7 


48 


2.38 


2.21 


-.17 


.04 


-3. 


83 


p<.001 


Urban 


7 


26 


2.54 


2.32 


-.22 


.06 


-3. 


76 


p<.001 


*A lower 


score is 


associa ted 


. with a 


more positive attitude. 
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Table III 

Comparison of Urban Fifth Grade Fall Experimental and 
Control Students on Overall Environmental Knowledge 



Sum o^ Squares 
Variation D/F 



Between 

Within 

Total 



1 

77 



Pre 

31.4141 
2268.54 
2299.95 



N-Exp., = 52 N-Cont. = 26 
Post Pre X Post 



290.828 
2147.63 
2438.46 



95 .5781 
1551.65 
1647.23 



Analysis of Covariance 
Variation D/F 



Between 

Within 

Total 



1 

75 
76 



Pre 

172.39 
1086.32 
1258.71 



Post 

172.39 
14.4843 
16.562 



Pre X Post Probability 
11.9019 p<.001 



Total Sum 1246 1608 

Grand Mean 15.9744 20. 6154 



Group Means for X Means for Y Adjusted Means 

1 16.4231 21.9808 21.6739 

2 ]5.0769 17.8846 18.4985 



Regression Coefficient = ,683989 
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Table IV 



Comparison of Urban Seventh Grade Fall Experimental and 
Control Students on Overall Environmental Knowledge 









]N]-Exp.=26 N-Cont. = 16. 


Sum of Squares 






Variation 


D/F Pre 


Post 


Pre X Post 


Between 


1 6.93164 


250.008 


41.6289 


Within 


40 864. 7il 


788.398 


547.586 


Total 


41 871.643 


1038.41 


589.215 


Analysis of Covariance 




• 


Variation 


D/F Sum of Sq. 


Mean Sq . 


F-?atio Probability 


Between 


1 198.473 


198.473 


17.5268 p<.001 


Within 


39 441.635 


1 1 , 324 




Total 


40 640.108 


16.0027 


, 




X 


Y 




Total Sum 


741 


905 




Grand Mean 


■17.6429 


21.5476 




Group 


Means for X 


Means for Y 


Adjusted Means 


1 


17.9615 r\ 


23.4615 


23.2597 


2 


17.125 ' 


18.4375 


18.7654 


Regression Coefficient = .633259 
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Table V 



Comparison of Rural Fifth Grade Fall Experimental 
and Control Students on Overall Environmental 

Knowledge 



Sum of Squares 
Variation D./F 



Pre 



Post 



N-Exp.=67 N-Cont.=22 



Pre X Post 



Between 

Within 

Total 



1 

87 
38 



104.074 
2465.52 
2569.59 



29.4023 
3086.12 
3115 



.-J. 53 



-55.3164 
2087.93 
2032.62 



Analysis of Covariance 
Variation D/F Sum of Sq. 



Between. 

Within 

Total 



1 
86 
87 



189.722 
1317.95 
1507.67 



Mean Sq. 

189.722 
15.325 
17.3296 



F- Ratio 
12.3799 



Probability 
P< .00 1 



Total Sum 
Grand Mean 



1430 

16.0674 



1578 

17.7303 



Group 

1 

2 



Means for X 

15.4478 
17.9545 



Means for Y 

18.0597 
16.7273 



Adjusted Means 

18.5845 
15.1292 



Regression Coefficient = .846853 
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Table VI 



Comparison of Rural Seventh Grade Fall Experimental 
and Control Students on Overall Environmental 

Knowledge 



N-Exp.=53 



N-Cont.=52 



Sum of Squares 
Variation D/F 



Pre 



Post 



Pre X Post 



Between 

Within 

Total 



1 

103 
104 



31.9609 
1683.43 
1715.39 



Analysis of Covariance 
Variation D./F Sum of Sq, 



Between 1 
W^ithin 102 
Total 103 



175.048 
1467.78 
1542.83 



274.469 
2011.09 
2285.56 



93.6562 
9 5 6 • 3 S S 
1050.02 



Mean Sq. 

175.048 
14.39 
15.9498 



F- Ratio 
12.1645 



Probability 
p<.001 



X 



Total Sum 2318 2546 

Grand Mean 22.0762 24.247'>5 



Group Means for X Means for Y Adjusted Means 

1 22.6226 25.8491 25.5386 

2 21,5192 22.6154 22.9318 



Regression Coefficient = .568102 
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Table VII 



Comparison of Suburban Seventh Grade Fall Experimental 
and Control Students on Overall Environmental 
Knowledge 



Sum of Squares 
Variation D/F 



Pre 



Post 



N-Exp.=48 



Pre X Post 



N-Cont.= 106 



Be tween 

Within 

Total 



1 

152 

153 



1278.28 

5083.8 

6362.09 



870. 187 
4950. 15 
5820.34 



1054.67 
2936.59 
3991.26 



Analysis of Covariance 

Variation D/F SumofSq. MeanSq. F-Ratio Probability 

Between 1 62.5459 52.5459 2.90252 p<.lU 

Within 151 3253.87 21 . 5488 

Total 152 3316.42 21.8185 



Total Sum 2703 3152 

Grand Mean 17.5519 20.4675 



Group Means for X Means for Y Adjusted Means 

1 • 21.8333 24 21.5269 

2 1 5.6132 18.8679 ' 19.9878 



Regression Coefficient = .577636 
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Table VIII 



Comparison of Suburban Fifth Grade Fall Expenment^.l 
and Control Students on Overall Environmental 

Knowledge 



Sum of Squares 






N-Exp.=52 N-Cont.=62 


Veria tion 


D/F 


Pre 


Post 


Pre X Post 


Between 

Within 

Total 


1 

112 
113 


52.0078 
1885.93 
1937.94 


t 

H D • y U 0 ^ 

2871.73 
2918.63 


1316.14 
1365.53 


Analysis of Covarianca 






Varia tion 


D/F 


Sum of Sq . 


Mean Sq. 


F- Ratio Probability 


Between 

Within 

Total 


1 

111 
112 


3.21021 
1953.23 
1956.44 


17.5967 
17.4682 


a iO HO £s p ^ . Z V. 






X 


Y 


*- 


Total Sum 
Grand Mean 


1775 

15.5702 


2016 

17.6842 




Group 


Means for X 


Means for Y 


Adjusted Means 


1 

2 


16.3077 
14.9516 


18.3846 
17.0968 


17.8699 
17.5285 



Regression Coefficient = .697872 
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Table IX 



Comparison of the Change of Attitude* 
by Control and Urban Fall Fifth 
Grade Experimental Students 



Sum of Squares 
Variation D/F 



Pre 



Post 



N-Exp. = 52 



Pre X Post 



N-Cont. = 25 



Between 1 
Within 75 
Total 7 6 



.687988 
7.56757 
3.25555 



1.5694 
8.65424 
10.2236 



1,.03918 
3.89954 
4.93872 



Analysis of Covariance 
Variation D/F Sum of Sq, 



Between 

Within 

Total 



1, 
74 
75 



.624321 
6.64482 
7.26914 



Mean Sq. 

.624321 
8.97949E-02 
9.69219E-02 



F- Ratio 



6.95275 



Probability 
P<.02 



Total Sum 
Grand Mear 



195.4 
2 . 53 / 36 



184.5 
2.3961 



Group 

1 

2 



Means for X 

2.47212 
2.674 



Means for Y 

2.29712 
2.602 



Adjusted Means 

2.33089 
2.53175 



Regression Coefficient = .515296 



*A lower score indicates a more positive attitude. 
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Table X 



Comparison of the Change of Attitude* 
by Control and Urban Fall Seventh 
Grade Experimental Students 











>^-Exp. = 26 N-Cont.= 15 


Sum of Squares 








Variation 


D/F 


Pre 


Post 


Pre X Post 


Between 


1 


.284546 


1.72641 


.700806 


Within 


39 


2.9474.5 


3.75903 


1 .74817 


Total 


40 


3.23199 


5.48544 


2.44897 


Analysis of Covariance 






Variation 


D/F 


Sum of Sq. 


Mean Sq . 


F-Ratio Probability 


Between 


1 


.907613 


.907613 


12.6698 p< .001 


Within 


38 


2.72217 


7.16361E-02 




Total 


39 


3 . 62979 


9.30714E-02 








X 


Y 




Total Sum 




106.75 


101.4 




Grand Mean 




2.60366 


2.47317 




Group 


Means for X 


Means for Y 


Adjusted Means 


1 


2. 


54038 


2.31731 


2.35484 


2 


2. 


71333 


2.74333 


2.67828 



Regression Coefficient = .5931J3 

*A lower score indicates a more positive attitude. 



Ta'irle XI 



Comparison of the Change of Attitude* 
by Control and Suburban Fall Fifth 
Grade Experimental Students 



Sum of Squares 






N-Exp.=52 


N-Cont. = G4 


Va riation 


D/F 


Pre 


Post 


Pre X Post 




Between 

Within 

Total 


1 

114 
115 


.415771 
12.584 
12.9998 


1.39185 
15.9954 
17.3872 


. 760742 
8.35962 
9 . 12036 




Analysis of Covariance 








Variation 


D/F 


Sum of Sq . 


Mean Sq. 


F-Ra tio 


Probability 


Between 

Within 

Total 


1 

113 
114 


.546535 
10.442 
10.9886 


.545535 
9.24072E-02 
9. 63908E-02 


5.91442 


p<.05 






X 


Y 






Total Sum 
Grand Mean 




298. 15 
2.57026 


290.6 
2.50517 







Group Means for X Means for Y Adjusted Means 



1 2.50385 2.38366 2.42777 

2 2.62422 2.6C391 2.56806 



Regression Coefficient = . 664306 

*A lower score indicates a more positive attitude. 



ERIC 



-16- 



Table XII 



Comparison of the Change of Attitude* 
by Control and Rural Fall Fifth 
Grade Experimental Students 



Sum of Squares 
Variation , D/F 

Between 1 
Within 88 
Total 89 



Pre 

3.38135E-02 

8.43774 

8.47156 



Post 

.201172 
14.2963 
14.4974 



N-Exp.=67 

Pre X Post 

-8.26416E-02 
4. 69434 
4.61169 



N-Cont. = 23 



Analysis of Covariance 
Variation D/F Sum of Sq, 



Between 

V\^ith.\n 

Total 



1 .30238 

87 11.6846 

88 11.987 



Mean Sq , 

.30238 
.134305 
. 136215 



F- Ratio 
2.25143 



Probability 
P>.15 



Total Sum 
Grand Mean 



240.7 
2.67444 



234.76 
2. 60844 



Group Means for X Means for Y Adjusted Means 

1 2.60582 2.58075 2.57442 

2 2.6413 2.68913 2.70757 



Regression Coefficient = .55635 

*A lower score indicates a more positive attitude. 



Table XIII 



Comparison of the Change of Attitude* 
by Control and Ruial Fall Seventh 
Grade Experimental Students 



Sum of Squares 
Variation D/F 

Between 1 
Within 103 
Total 104 



Pre 

.157837 
9.49646 
9.6543 



Post 

.34906 
11.2265 

11,5756 



N-Exp. = 53 N-Cont. = 51 



Pre X Post 



.234741 
5.08557 
5.32031 



Analysis of Covariance 
Variation D/F SumofSq, 



Between 

Within 

Total 



1 .14057 

102 8.50306 

103 8.64363 



Mef:in Sq. 

.14057 
8.33633E-02 
8.39188E-02 



F- Ratio 
1 . 68623 



Probability 
P> .20 



Total Sum 
Grand Mean 



238.5 
2.27143 



231.45 
2.20429 



Group 

1 

2 



Means for X 

2.23302 
2. 31058 



Means for Y 

2. 14717 
2.2625 



Regression Coefficient = . 535523 



Adjusted Means 

2. 16774 
2.24154 



*A lower score indicates a more positive attitude. 
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Table XIV 



Comparison of the Change of Attitude* 
by Control and Suburban Fall Seventh 
Grade Experimental Students 



Sum of Squares 

Variation D/F Pre Post Pre x Post 

Between 1 .686035 .977783 .819092. 

Within 154 20.0542 24.4792 13.1431 

Total 155 20. 7402 25.457 I3.'0.?,2 



N-Exp.=48 N-Cont. = 108 



Analysis of Covariance 

Variation D/F Sum of Sq. Mean Sq. F- Ratio Probability 

Between 1 . 192238 . 192238 1 .85385 P>.20 

Within 153 15.8656 . 103697 

Total 154 16.0578 .104272 



Y 



Total Sum 386. 18 364 

Grand Mean 2.47551 2.33333 



Group Means for X Means for Y Adjusted Means 

1 ' 2.37604 2.21458 2.27977 

2 2.51972 2.38611 2.35714 



Regression Coefficient = .655377 

*A lower score indicates a more positive attitude. 
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Although the performance objective 1.1.9 is scheduled for completion 
in May, those students and teachers involved in the fall session (Table XV) 
indicate (with 10 of the 11 teachers responding) that the criterion of 90% 
of the project students involved in the solution of an environmental problem 
,was met, while all (100%) of the students (see Table XV) felt they had 
been involved. Although not criterion referenced, the control teachers and 
students responses to the same question (see Table XV) indicate that in 
only one instance was an environr).ental problem discussed. 



Table XV 

Comparison of Experimental and Control Students 
and Teachers in Identifying and Solving 
Environmental Problem in School 







Teacher 




Student 








Yes 


No 




Yes 




No 




N 


% 


N % 


N 7o 


N 


% 


Experimental 


9 


90 


1 10 


50 


100 


0 


0 


Control 


1 


12.5 


8 87.5 


9 


22.5 


31 


78.5 



One might argue that involvement of experimental students in 
environmental problems and solutions in the classroom might not be 
attributable to interest but rather to the mandatory nature of formal 
education; however, participation in community activities is strictly 
voluntary. Students volunteering to work on community environmental 
projects is indicative of the ripple effect of the Nolde program and also 
the generated interest in our environment. In response to the student 
questionnaire, 70% of tht students indicated they had been or were 
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involved in community environmental activities. This far exceeds the 
10% establishv^d criterion for performance objective 1.10. 

III. EVALUATION OF INSTRUCTIONAL C . ERATION PROCESS OBTECTIVES 

It is important that evaluation of the instructional process be observed 
and rated by the Project Director or a member of his staff to determine the 
experimental teacher's expertise, enthusiasm, knowledge of the project 
and the general classroom teaching/learning situation. In November, 
Mr. Ritrovato, Project Director, rated the fall experimental teachers 
and these ratings appear in Table XVI. 

Performance objectives 1.2.1, 2, and 6 require a rating of at least 
three on a five-point scale for use of curriculum materials, outside 
materials, and for demonstration of enthusiasm in working on the project. 

Table XVI indicates all teachers (100%) exceeded this rating on 
objective 1.2.1, 1.2.2, while on objective 1.2.6 all but one teacher 
(90%) were rated 4 or better. 

The teacher's log is the instrument devised to record and/or 
reinforce these operational process objectives: the identification and 
solution of a local problem (1.2.3), Nolde field trips (1.2.4), the use 
of community resource personnel (1.2.5) and facilities (1.2.7) in addition 
to verifying that such reports exist (1.2.8). Table XVII summarizes the 
ERANDA findings. This log acts as an excellent tool for cross-indexing 
other evaluation instruments. 
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Table XVI 

Project Director's Rating - Fall Experimental Teachers 
November 29, 1972 

N=ll 

Evaluation A B, C D_ E 

1. Use of project curriculum 9 2 0 0 0 
materials 

2. Supplement of project 9 2 0 0 0 
activities with outside 

materials 

3. Demonstrated enthusiasm 7 3 10 0 
toward project (teacher) 

4. Students demonstrated 7 3 10 0 
enthusiasm toward project 

5. Knowledge of project 9 2 0 0 0 
curriculum 

6. Knowledge of project 10*1 0 0 0 
facilities 

7. Understanding of project 6 4 10 0 
philosophy 

8. Teaching ability 9 2 0 0 0 

9. Ability to evaluate 8 3 0 0 0 
student's performance 

10. Knowledge of other community 7 4 0 0 0 
environmental facilities 

11. Knowledge of community 2 7 2 0 0 
resource personnel 

12. Attitude toward project 8 3 0 0 0 



Scale: A: Excellent 

B: Good 

C: Fair 

D: Poor 

E: Unacceptable 
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Table XVII 



Teacher's Log Report 
Fall Expeiimentai Group 

N-U 



Yes No 

N % ■ N % 

1.2.8 Prepared Log 11 100% 0 0 

1.2.3 Identify Problem 11 100% 0 0 

1.2.3 Discuss Solution 11 100% 0 0 

1.2.4 *Nolde Field Trip U 100% 0 0 

1.2.5 **Used Community 6 54% 5 46 
Resource Personnel 

1.2,7 ***Used Community 8 72% 3 27 

Resource Facilities 



* 7 indicated two trips 

** 2 indicate^- more than one 

*** 4 indicated more than one 
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AH eleven fall experimental teachers submitted teacher logs (100%) 
meeting the established criterion for 1.2.8. The criterion of 100% was 
also met for lc2.3, while 1.2.4 was met by all and exceeded by 7 
experimental schools who visiced Nolde twice. The criterion of 20% for 
objectives 1.2.5 and 1.2. 7 were exceeded when 6 (54%) of the groups 
used community resource personnel and 8 (72%) used community facilities 
(see Table XVII). 

The objective requiring post testing of experimental students was 
met on December 11 and 12 and was observed by ERANDA to determine 
that correct testing procedures were followed. 

The Operational Process Objectives were met in ail instances and 
exceeded in those already indicated. 

IV. EVALUATION OF THE FALL EXPERIMENTAL SCHOOLS 

Utilizing three diverse sources of information^ the fall experimental 
schools were evaluated. 

1. Teacher logs not only provide specific information to determine 
the degree to which behavioral objectives have been met but ^ 
include much soft data of a very valuable nature. 

2. The ERANDA staff has visited each fall experimental school 
and spoke with teachers (and students where feasible). 

3. The Nolde staff member responsible for the school has 
written a comprehensive report. Evaluation of Fall 
Experimental School Programs . 

They are presented in two sections: Primary (5th grade experimental 
schools) and Secondary (7th grade experimental schools). 

Primary : 

Womelsdorf Elementary School - 5th Grade 
Teacher: Mr. John Zug 

T ' students in Mr. tug's fifth grade demonstrated an Increasing 
concern for their environment. This was evidenced by the energy with 



which they approached all their activities, especially their development 
of a 44-item community questionnaire. Other projects which evoked 
students' interests included the establishment of an outdoor study area, 
building bird feeders, water studies, and an analysis of effects of water 
on different paper products, Mr. Zug reports that his students have been 
very responsive to the project, especially their visits to the Nolde 
facilities . 

Parent reactions appear to have been favorable. Parents cooperated 
by leading small groups on field trips and one lady bothered to contact 
the principal and indicate that she was impressed with the student's 
involvement in community problems. 

One valuable by-product of the project was the development of an outdoor 
education area to be used by other groups in the school, Mr, Zug compiled 
a guide booklet including a description of a nature trail, and suggested 
activities. These efforts cannot help but broaden the sphere of influence 
the Nolde project will eventually realize. 

Blue Mt. Elementary School - 5th Grade 
Teacher: Mrs. Lorraine Jones 

Mrs. Jones indicated that she personally benefited from being involved 
with the Nolde project. She stated that the opportunities for her to interact 
with other teachers in the project were most rewarding. An observation by 
the ERANDA staff found the students and teacher to be very enthusiastic 
about the project. Mrs. Jones also indicated her use of the Nolde curriculum 
has been very successful. Students became involved in projects such as: 
reforesting a nearby woods and developing nature trails there. Student- 
centered discussion of water pollution was sparked by a trip to a community 
sewage treatment facility* Parent's responses were favorable. This became 
evident by the many replies Mrs. Jones received from parents offering 
assistance in the class's v.'ork on a community problem. The influence these 
efforts had were not limited to the one class. The students of Mrs. Jones 
presented an assembly about ^'Endangered Species'* to some 500 children 
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in the elementary school. In general, the effect of Nolde project on the 
students has been favorable for as Mrs. Jones stated, "... the children 
were developing a healthier attitude toward the environment". 

George Wolf Elementary School - 5th Grade 
Teacher: Mr. Richard Becker 

Observations made by the ERANDA staff again indicate a very 
enthusiastic teacher. This enthusiasm is no doubt spilling over to the 
students. Students concerned themselves with the condition of a local 
stream and how it was influenced by the discharges of a sewage plant. 
Students volunteered their services to the sewage plant manager to assist 
him in building a diversionary dam to help improve water quality. The 
children were very energetic about this project. So much so, the plant 
manager commented that, given the time, the helpers would have built a 
dam big enough to cause the stream to overflow. Organization of the students 
effort was very efficient. Five small groups were formed allowing many 
facets of the stream to be analyzed. While no formal committee of parents 
was formed, their assistance was readily available when needed. 

Twin Valley School District, Berks County - 5th Grade 
Teacher: Mrs. Judy Marrogelle 

One of the interesting aspects of this project was the u3e of a magic 
circle. The students would talk freely about their feelings coiicerning the 
environment. Students' reactions were good. An integral part of the success 
of the program was the cooperation of the executive committee of the Home 
and School Association. This group volunteered to serve as a community 
council for the project. An inter-^disciplinary approach was employed 
utilizing both mathematics and the language arts in varied activities. The 
teacher noted an increase in the use of library books which related to the 
topics being discussed. Class visits to a local canal site were limited by 
both transportation and weather problems. Class activities were varied. 
The students are planning to construct a publicity booklet for the purpose 
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of increasing the awareness of the community towards environmental problems 
and their solutions. Miss Marrogelle indicated her feeling that the students 
enjoyed their trips to Nolde and that they gained much valuable information 
from them. 

Schoeneck Elementary School - 5th Grade 
Teacher: Mr. David Burns 

Mr. Burns was working with the equivalent of a fifth grade group in a 
non-graded elementary school. Students studied the effect of the Pennsyl- 
vania Turnpike on the noise level in the area. It is interesting to note Mr. 
Burns comments on the changing attitudes of his students throughout the 
program: 9/15/72: "students attitudes are passive - apathetic"; 10/9/72: 
"students had good reactions - encouraging; 10/25/72: "continued interest 
demonstrated - encouraging!". Employing a learning center technique, the 
teacher's approach was to a degree inter-disciplinary. A vocabulary teacher 
assisted by instructing the students on environmental terms. Graphing 
was employed to create pictorial representations of differing decibel levels. 
During the final week the program took on a literature orientation emphasizing 
prose, poetry, etc. 

While these efforts appeared to affect positive influences to the 
children, parental response was discouraging. As Mr. Burns commented, 
"They didn't seem to want to get involved". 

Wyomissing Elementary Center - 5th Grade 
T^. ;her: Miss Barbara Hibscham 

The fifth graders in this school concentrated their efforts on the varying 
types of solid waste pollution. After initial discussions of environmental 
problems the students concentrated on cleaning up the litter in both the 
school area and in a local community park. Items collected were then 
analyzed to inform the students cf the different rates at which the items 
could be decomposed. Bar graphs were employed to represent the relative 
frequency with which each form of trash was found. By comparing the graphs 



of the school grounds with the park, students were made aware of the types 
of people who are responsible for the different lypes of litter. Art projects 
employing collages, mobiles, etc, afforded the students an opportunity to 
both express themselves and also motivate others to become concerned with 
the litter problems. One comment by Miss Hibscham is of special interest. 
Referring to the efforts of her students in organizing a presentation for the 
PTA, Miss Hibscham said, "They worked hard, dedicating their time after 
school and on weekends willingly and cooperatively". 

Secondary : 

Cocalico Area Middle School - 7th Grade 
Teacher: Miss Georgia Barrett 

Miss Barrett indicated she enjoyed the November in-service program at 
Nolde. She felt it was profitable to'hear other teacher's problems and discuss 
them. Student activities were many and varied, ranging from building bird 
feeders to designing plans for an outdoor study area involving the use of 
a non-functional sewage plant located nearby. Parent cooperation was good 
as e'^ndenced by the 16 {of a possible 23) parents who volunteered for 
committee work. Miss Barrett's record of student's response to Nolde Park 
field trips indicates very positive student attitudes toward these activities. 
Miss Barrett generated an inter-disciplinary approach eliciting the support 
of math, English, and art teachers. 

Perhaps the most beneficial outcome of this project involvement is 
Miss Barrett's plans to work with a teaching team toward developing a 
special curriculum on ecology for use in earth science studies next year. 

Conestoga Valley School District - 7th Grade 
Teacher: Mr. Joseph Forrey 

Upon observation, Mr. Forrey appeared as a bright, enthusiastic, 
mild-tempered instructor. Working with the students, they decided to 
study a local creek and the plans of the CVA (a local watershed authority) 
to develop a recreational araa along the creek. While Mr. Forrey used the 
Nolde curriculum, he found it necessary to alter it so as to be more meaningful 
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to his students. Student involvement in the project was motivated by 
many of the activities and in particular a IQ mile canoe trip for the purpose 
of water studies* The students were accompanied by a reporter from a 
Lancaster newspaper who afforded the project with extensive press coverage. 
Parent cooperation when specificaliy needed was excellent but they appeared 
to resist the organization of a formal council. Mr* Forrey was able, 
however, to solicit the services of CVA members who volunteered to serve 
as an advisory council. It is interesting o note that the students regretted 
they were unable to accomplish much toward the solution of their problem. 
They felt they should have selected a more specific problem which would 
have lended itself more readily to solution. 

Governor Mifflin Junior High School - 7th Grade 
Teacher: Mr. Kenneth Hain 

Based on observations made by ERANDA staff, the students appeared 
to be both enthusiastic and energetic about their project involvement. 
Mr, Hain presents himself as an experienced and confident teacher. As 
in other schools parent involvement seemed to be limited to informal 
cooperation. Parents did not seem anxious to form a formal committee. 
Students concerned themselves with the impact of man's presence on the 
condition or a local creek. An inter-disciplinary approach to the project 
involved both the math and h^'story department. Some plans for continuation 
of program are of great value. These include a campaign in the spring 
directed towards cleaning up the creek and soliciting cooperation from the 
community to maintain the creek. Also. planned is the production of a video- 
taped program depicting the activities of the program to be made available 
to local educational T*V. channels. Future plans of this type make great 
strides toward increasing the viability of the desired long term effects of 
the Nolde project, 

St. Paul's School - 7th Gr^de 
Teacher: Miss Rosanna Moyer 

Miss Moyer, a first year teacher at St, Paul's, was afforded a very 
iewarding experience due to both her own motivation and her involvement 
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with the Nolde project. At the onset of thi program, Miss Moyer seemed 
plauged by both uncooperative students and pesimistic co~horts on the 
faculty. She was cynically warned by her fellow teachers about the lack 
of parental interest at St. Paul's. However, at h<^: lirst meeting with some 
21 (out of thirty contacted) parents, 13 parents committed themselves to 
cooperating with the project. Miss Moyer commented, "The parents were 
very receptive and very optimistic". While the students at first appeared 
apathetic and disinterested, by November 7 Miss Moyer reported, "The 
students were really interested", in that day's exercise. There was also 
a marked improvement in the students' behavior during the second trip to 
Nolde as compared to their first trip. The program concentrated on noise 
pollution. Miss Moyer reported that students learned to discriminate 
betwBc^n the different sound levels produced by man-made devices, by 
contrasting tapes made in urban areas and at the Nolde Park. 

Wilson Junior High School 
Teacher: Mr. Michael Gerhart 

Mr. Gerhart, a capable and organized teacher, received much support 
from both students and parents in his efforts. Students wrote to some 65 
agencies, requesting information on the environment. The first meeting 
with parents met with great success, some 40 parents attending, 22 of which 
volunteered to work witii the project. One parent discussion concerning 
what an organized group could do in a community resulted in the organization 
of local council. Students were exposed to several school personnel, e.g., 
the school business manager, school transportation director, and also made 
several field trips including Punches River, Angelica Creek, Cacoosing Creek , 
and a local Sewage Creek. Students activities were varied concentrating on 
the analyzing of local litter finds and water conditions in local streams. 
Students seemed to be well directed towards finding solutions for their 
problems. Future plans include inviting other sections in the school to 
cooperate and organizing meetings involving local representatives of community 
groups. These meetings are geared towards controlling the pollution of the 
environment. 
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V. EVALUATION OF INSTRUCTIONAL MANAGEMENT PROCESS COMPONENT 

The facility development was curtailed during the first year of the program 
due to the dismissal of the firm originally contracted to provice such services. 
Additionall'/f decisions congruent to the philosophy of the newly appointed 
Project Director had to be made concerning the locP.le of teaching stations 
and the best utilization of the property. Now, early in 1973, two teaching 
trails have been completed: Watershed and Earth. On Watershed Trail 
two teaching stations are built while on Earth Trail the construction for 
two teaching stations is underway meeting the criterion for Objective 1.3.4. 

Assistance from the Nolde staff to project teoohers is necessary for 
a successful project. In order to determine the effectiveness of this 
assistance, project teachers were asked to respond to a questionnaire. 
The results appear in Table XVIII. The criterion for Objective 1.3.7 is 
90% of the teachers reporting that the staff responded within 5 days and 
that the response was satisfactory. With 10 of the 11 experimental 
teachers reporting, the criterion was exceeded in all areas. All (100%) 
reporting teachers indicated that the Nolde staff responded within 5 working 
days and that the response was satisfactory. It is interesting to note' that 
the largest numbers of requests are for speaking engagements and for 
instructional and technical assistance. 

Pre and post testing of the fall group and pre testing of the winter group 
were all completed on time and in accordance with the established criteria 
for Objectives 1.3.8 and I.3.S. The testing was monitored by the Nolde 
staff and randomly checked by members of the ERANDA staff. 

The established criterion for all objectives for the Instructional 
Management Process Component were met or exceeded. 
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VI. EVALUATION OF STAFF DEVELOPMENT PRODUCT 

The discipline of environmental education is a new and constantly 
evolving area. Therefore, teachers and project staff participating In a 
project on environmental education should constantly be growing In their 
personal expertise. The objectives in this component are aimed at evaluating 
the degree to which thfs growth Is occurring. Although the dates originally 
scheduled for some of these objectives were In September, the Project 
Director felt rating of behaviors which might indicate considerable knowledge 
of the project would more reasonably be accomplished In November. The 
results of his November rating of project teachers can be found in Table XV. 
The criteria of 100% of the experimental teachers being rated at least a 
three on a five-point scale for Objectives 2 . 1 . 1 , 2.1.2^ 2.1.5, 2.1.6, 
and 2.1.8 was reached for all objectives. In addition. Objectives 2.1.3 
and 2.1.9 required 90% of the teachers to receive a rating of three or 
better on a five-point scale. This criterion was exceeded for all (100%) 
of the teachers were so rated* (See Table XM, page 22) 

In order to determine the degree to which the staff Is growing In 
environmental knowledge, the Project Director rated his staff (extending 
the scheduled date from September to January). The results appear In 
Table XIX. Objectives rated were 2.1.12, the ability to Identify local, 
state and national environmental problems and solutions; 2.1.13, to 
Identify local, state and national educational programs and facilities; 

2.1. 14, to demonstrate adequate knowledge of the project curriculum; 

2.1. 15, to demonstrate adequate understanding of project facilities, 
functions and philosophies; 2,1.17, to demonstrate administrative competency 
in execution of assigned tasks; 2.1.18, adequately conduct pre-servlce 
training; 2.1.19, adequately conduct pre-servlce training. The criterion 
established for each of these objectives Is a Project Director's rating of at 
least three on a five-point scale. Without exception, this criterion has 

been exceeded, as all staff members received a rating of 4 or better on all 
objectives. In many instances, all staff members were rated 5 or excellent. 
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For Objective 2 A. 16, demonstrates ad^.quate teaching abilities, a 90% 
criterion of at least three was established while 100% of the staff is 
rated 5, or excellent (see Table XIX). 



Table XIX 



Project Director Rating of Project Staff 
January, 1973 

N:=3 



Task 



Identify local, state and 
national environmental 
problems and solutions 



A 
3 



B 
0 



Ratings 

C 
0 



D 
0 



= Excellent 
B = Good 
C= Fair 
D= Poor 

E = Unacceptable 



E 
0 



2. Identify local, state and 3 
national environmental 
programs and facilities 

3. Adequate knowledge of 3 
project curriculum 

4. Adequate understanding 3 
of project facilities 

5. Understanding of project 3 
functions 

6. Understanding of project's 3 
philosophies 

7. Adequate teaching abilities 3 

8. Adequately conduct pre- 3 
service training 

9. Administrative competency 2 
in execution of assigned tasks 

10. Adequately conduct in-service 3 
training 



ERIC 



11. Actively participate in staff 



meetings 



1 
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0 
0 



0 
0 



0 
0 



0 
0 



Additional responsibilities fall to the elementary and secondary 
project coordinators. A close and continuous contact between the 
coordinator and each experimental program must be maintained. Per- 
formance Objective 2.1.20 requires twice monthly meetings complete with 
minutes. Such minutes do not exist; however, experimental teachers 
verbally stated to the ERANDA staff members who observed their programs 
that the Nolde staff was in constant contact. The log reports from the 
secondary coordinator substantiated his regular meetings. Such a log was 
not available from the elementary coordinator. Although the formal criterion 
was not met due to lack of minutes, the evaiuators feel the intent of the 
objective was satisfied. 

Performance objective 2 . 1 . 22 requires the coordinators' attendance 
at advisory council meetings, at least 6 for the school year. The Project 
Director has decided, due to shortage of staff, to require staff attendance 
at advisory council meetings only when the agenda requires their expertise 
or when the meeting is of special interest to them, and thus far they have 
attended only two meetings. Therefore, this criterion was not met. In 
addition. Objective 2.1.23 requires staff attendance at two local advisory 
committees for each experimental group. Minutes of the meetings are criterion 
evidence. No minutes exist from local advisory committee (LAC) meetings. 
Evidence of the existence of LACs are the eighteen lists provided by the 
Project Director and responses by project teachers concerning attendance 
at such meetings. 

The evaiuators learned in their meetings with the experimental teachers 
t:hat, although formal lists exist, formal meetings have not been the outcome. 
Rather, when assistance was needed to expedite the work of the project, the 
committee was contacted and help was always forthcoming. The criterion 
for this objective, however, was not achieved. 

It is important that information about the Nolde Forest State Park be 
disseminated to as large a population as possible. Speaking to community 
groups (Objective 2.1.24) is an effective way of accomplishing this. 
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Examination of the secondary coordinator's log indicates that eight presen- 
tations have been made since September. In addition, at least 12 in-sprvice 
meetings were prepared for toachers at all grade levels in the district, at 
levels K to 12. 

The elementary coordinator logs were not available for assessment. 
In spite of this omission, the criterion for the objective has been met. 

The project coordinators are expected to develop learning activities 
which can be used as curriculum supplements by teachers. Objective 
2.1.25 requires one unit per month per staff member. No formal record 
has been kept as to individual input; however, the number of activities 
now available totals 350. This number greatly exceeds the criterion 
established. 

Regular contributions about Nolde through news media and the Project 
Newsletter are required of the project staff (Objective 2.1.26): Tne 
contribution of one article to local news sources and one article in each 
issue of the Newsletter. Space does not permit input by all staff In each 
issue of the Newslettr^r but all staff members are regular contributors. 
This does not meet the established criterion. 

The field trip community guides are knowledgeable personnel whose 
responsibilities have been delineated in the following manner. The field 
trip community guides are expected to (Objective 2.1.27) aid teachers and 
project staff during field trips, (Objective 2.1.28) aid project coordinators 
by maintaining and organising instructional materials and equipment^ 
(Objective 2.1.29) aid the project staff in the execution of assigned duties, 
(Objective 2.1.30) demonstrate positive attitudes toward the project manage- 
ment team and (Objective 2,1.31) adequately conduct field experiences at 
the Nolde site. The criterion for each of these objectives is a rating by the 
Project Director of three or better on a five-point scale. Table XX indicates 
that all guides exceeded the criterion on all objectives by achieving a rating 
of Qt least 4 . 
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Table XX 



Project Guides Rating by Project Director 
January^ 1973 
N=18 



Activity 



1. Aid teachers and staff 
during field trips 

2. Maintain and organize 
instructional materials 
and equipment 

3* Aid project staff in the 
execution of assigned 
duties 



Ra ting* 
BCD 
0 0 0 



4. Demonstrate positive 
attitude toward Project 
management team 

5. Adequately conduct field 
experiences at the Nolde 
site 

6,, Demonstrate an adequate 
knowledge of environ- 
mental concepts 



*A = Excellent 
B = Good 
C= Fair 
D= Poor 

E = Unacceptable 



VII. EVALUATION OF STAFF DEVELOPMENT OPERATIONAL PROCESS 
OBJECTIVES 

There are only three objectives relating to this component to be 
evaluated in January. The adequacy and immediacy of response to requests 
for in-service training and consultant services are the thrust of Objectives 
2.2.2 and 2.2.4. A questionnaire was submitted to teachers, community 
persons, local and central advisory committee members. The results of 
that questionnaire appear in Table XXI. It was required that 100% of those 
responding to the questionnaire report that the Nolde staff responded 
within 5 working days and that 80% of those responding found the response 
adequate. 



Table XXI 

Noldo Staff Assistance to Speakers and Project Teachers 
January, 1973 
N=21 



Type of Assistance 



Ratinq 
3 



la 


Secreta rial 


5 


4 


90 1 0 


0 


11 


2a 


MoF ting Place 


12 


4 


100 0 0 


0 


5 


3a 


A- V Equipment 


4 


4 


88 1 0 


0 


12 




to Local and Central Advisory Committees 












January, 


, 1973 












N- 


22 






lb 


Secretarial 


6 


3 


90 1 




12 


2b 


Supplies 


7 


6 


100 




9 


3b 


Meeting Place 


13 


4 


100 




S 


4 


Project Act. 


13 


4 


100 




S 


5 


Rating** 


14 


3 






S 


6 


Response to 
Request^^i 


10 


3 






9 



5 Very adequate 2 Inadequate 

4 Adequate 1 Very Inadequate 

3 Neither adequate 0 Did not request 
not Ir.rid equate 



il 



All the time 
Most of tho time 
About half the tlrr.e 
Almost never 
Never 



ill 



Very adequate 
Adequate 
Inadequate 
Very inadequalo 
Did not request assistance 
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Table XVIII, page 32, indicates that the objective was met for 100% of the 
responding teachers indicated that they had received a response within 
5 days and that they all found t le response adequate; while Table XXI 
(5 & 6) indicates that local and central advisory committee members who 
requested assistance did receive a prompt response and 100% found the 
response to be either adequate or very adequate. 

Objective 2.2.3 reflects how effective the staff input is in staff 
meetings. Table XIX, page 34, indicates that all the staff exceeded the criterion 
of a rating of three or better on a five- point scale. 

VIII. EVALUATION OF STAFF DEVELOPMENT MANAGEMENT PROCESS 
OBTECTIVES 

The arrangements for in-service training should be accovnplished 
promptly in a manner satisfactory to those requesting the training 
(Objective 2.3.7). A questionnaire was submitted to the experimental 
teachers and those community personnel requer^ting in-service training. 
The criterion was that 90% would respond that they were contacted within 
5 working days with satisfactory results. Table XVIII, page 32, indicates that 
all (100%) teachers who requested in-service training received a response 
within 5 days and rated the response at least satisfactory. 

A staff to function well must be well informed. Objectives 2.3.8, 
2.3.9 and 2.3.10 require good communication between Director and staff 
concerning all meetings, what has transpired and what in-service needs the 
staff may have. Table XXII indicates all staff members are regularly 
informed and that the criteria for these objectives have been met. 

In addition, bi-weekly meetings are to be conducted with the staff 
(Objective 2.3.11) and aides (Objective 2.3.12). Minutes exist to sub- 
stantiate that these meetings are being held. 

IX. EVALUATION OF MATERIALS DEVELOPMENT PRODUCT 

On-going reports of the project can be a useful tool to evaluate progress. 
The staff is required to submit interim reports (Objective 3.1.1) which 
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Table XXII 

Staff Questionnaire 
January, 1973 
N=3 



Receive Written Agenda 








Yes 




No 




Regular Staff Meetings 








3 




0 




Special Staff Meetings 








3 




0 




Advisory Committee Meetings 








3 




0 




Receive Minutes 
















Staff Meetings 








3 




0 




Within 5 Days 








3 




0 




Surveyed for Needs for In-Service 








3 




0 




Assista nc 


e Rec 


eived 












Need 








Rating* 








5 


4 


3 




2 


1 


0 


Secretarial Assistance 


1 


2 


0 




0 


0 


0 


Meeting Place 


1 


2 


0 




0 


0 


0 


A-V Equipment 


1 


2 


0 




0 


0 


0 


*Key; 5 = Very Adequate 
4 = Adequate 

3 = Neither Adequate nor Inadequate 

2 = Very Inadequate 

1 = Did Not Request nor Use It 
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consisted of extensive reports on the fall experimental programs. Staff 
members are to also maintain a daily work log (Objective 3.1.3) which can 
be an effective tool for evaluation, cross-indexing, verification and recall. 
One staff member submitted copies to the evaluators; the other keeps an 
appointment calendar log which ERANDA checked at NoMe. 

All staff members should maintain logs. This objective was not met. 

Objective 3.1.4 requires a monthly report delineating staff roles 
within the project. Monthly reports have not been written, hence, this 
objective has not been met. 

A bi-monthly Newsletter (Objective 3.1.7) has been published c=ind is 
disseminateci to a constantly expanding list of interested persons. Also, 
environmental resource library (Objective 3.1.8) is constantly being 
improved. Criteria for these objectives have been met. 

Although not due for completion until February, the Director's Quarterly 
Report (Objective 3.1.10) is completed and has been disseminated. It is 
extremely informative and should be read by interested parties. 

The work logs, previously referred to as the teacher's logs, for all 
(100%) the experimental teachers (Objective 3.1,12) are available. This 
performance meets the criterion set for this objective. 

Two objectives in this component are not being met. Staff logs are 
required of all staff members; with the exception of the secondary coordinator, 
these logs are not being kept. In addition, monthly reports delineating staff 
responsibilities are not being kept. All other objectives have been met. 

X. EVALUATION OF MATERIALS DEVELOPMENT OPERATIONAL PROCESS 
The close cooperation between experimental teachers and the Nolde 

staff should lead to teacher involvement in staff reports (Objective 3.2.1). 

The experimental teachers' input in the staff interim report is evidenced 

by the utilization of information in teacher logs. 

Objectives 3.2.3 and 3.2.4 require the design and distribution of 

forms to the project staff for assessing their needs and the analyzing and 
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distribution of the data obtained. Such information is part of the regular 
bi-monthly staff meetings. Additionally, the central community advisory 
committee has initiated preceding to aid in the needs assessment. 

Objectives 3.2.10 and 3.2.11 require bi-monthly production and 
distribution of a Newsletter. A regular bi-monthly Newsletter is prepared 
and disseminated to a mailing list of over 350 individuals, schools, civic 
organizations and others requesting it. 

A formal questionnaire was mailed to 148 persons to determine the 
percent of recipients who were receiving the Newsletter, Of 148 questionnaires 
distributed, 116 (78%) were returned. Of those responding, twenty-eight 
percent indicated they, received no materials, 81 (70%) indicated they had 
received the Newsletter, falling short of the established criterion of 90%. 

Objective 3.2.15 requires speakers to respond to a questionnaire designed 
to elicit whether or not the Nolde staff was prompt (within 5 days) in 
responding to requests and that 80% responding that arrangements were 
adequate. Table XXI, page 38, indicates that all speakers responding to the 
questionnaire indicated that they had received a response within 5 days and 
found the arrangements adequate. 

Although in general the Nolde production meets the established criteria, 
the percentage of persons responding to having received the Newsletter 
falls short. 

XI. EVALUATION OF MATERIALS DEVELOPMENT MANAGEMENT PROCESS 

It is important to any organization that secretarial assistance, meeting 
places and audio-visual tools are available to staff mem.bers and other 
persons logically requiring their assistance. Objectives 3.3.1^ 1, and 3 
require the Project Director to be responsible for providing such assistance. 
Questionnaires were sent to staff members, teachers, council members and 
speakers to elicit their assessment of the services provided them. Table XXI, 
page 38, indicates 90% or more of experimental teachers and speakers found the 
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secretarial assistance and meeting places adequate. However, the A-V 
materials fell slightly below th^ criterion of 90% (88%). The staff responses 



found in Table XXII, page 40, indicate the whole staff (100%) found all three 
adequate to meet their needs. 

The environmental resources library is a valuable source of materials 
for staff- Objective 3.3.7 delineates the time-line for the procurement 
of additional materials. This time-line was not only followed but was 
completed earlier than scheduled. 

The objectives in this component with slight deviation have been met. 

XIL EVALUATION OF COMMUNITY INVOLVEMENT PRODUCT 

Product objectives are primarily contained in the final report. However, 
in order to assess the degree to which the program is moving toward meeting 
long range goals, they will be touched upon briefly. Objectives 4.1.7 
and 4.1.3 require use of the Nolde site by 200 community members and 
students (7,500) not connected with the project participants. To date, the 
user logflhble XXIII) indicates that these goals will be met. The user log 
also indicates the type of meetings Held with breakdown per grade level, 
pre-school to college senior and adult. It is an effective presentation. 
In May the data will be analyzed to determine if specific numbered 
criteria have been met. 



Table XXin 



Comparison of 1971-2 and 1972-3 Participation ot Nolde Forest 

State Park Site 



71-2 



72-3 



September 



0 



508 



October 



100 



1 .519 



November 



65 



1,129 



December 



25 



232 
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The use of Nolde site by community members not involved in the 
project is the target audience for Objective 4.1.9. Using the user log for 
the four months of September through December, 1972, there is an indication 
of 24 programs which were held in response to various community agency 
requests. This performance far exceeds the established criterion of 5 
such meetings. It should also be mentioned that many additional requests 
were not honored due to the shortage of staff. 

The behavioral objectives in this component are not scheduled for 
completion until May. Survey of performance to date indicates the 
objectives are proceeding adequately. 

XIII. EVALUATION OF COMMUNITY INVOLVEMENT OPERATIONAL PROCESS 
OBTECTIVES 

This component assigns the Project Director certain responsibilities 
in eliciting community participation of an advisory nature. Objective 4.2.1 
requires an invitation be sent to the community-at- large for all project 
program areas. Copies of such invitations have been received by EPV\NDA. 
The Director is also responsible for holding bi-monthly advisory committee 
meetings (Objective 4.2.4). The minutes for these meetings confirm such 
meetings have taken place. However, minutes of local advisory committee 
meetings (Objective 4.2.5) do not exist. 

In order to determine the amount of involvement local and central 
advisory committee members experience, they were asked to respond to a 
questionnaire concerning project planning, needs assessment, dissemination 
and evaluation. Their responses appear in Table XXIV. The table clearly 
indicates many members were involved in Nolde activities. Of those 
responding, 75% or more felt tlieir involvement was favorable. 

Objective 4.2.9 requires detailed minutes for local and central advisory 
committee meetings. As was previously mentioned, minutes cf local 
advisory council meetings do not exist. 

The objectives in this component have been met for the central advisory 
committee* However, at the local level criteria are not being met. 
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Table XXIV 



Extent of Involvement in 
Nolde State Forest Program 
by Local and Central Advisory Committee Members * 

January, 1973 

N=23 



Activity 


0 


1 


% 


2 


% 


Project Planning 


8 


2 


14 




86 


D<)llneating Activities 


12 


2 


19 


9 


81 


Establishing Priorities 


8 


3 


25 


12 


75 


Project Evaluation 


8 


1 


7 


14 


93 


Dissemination 


12 


2 


19 


9 


81 



♦Central Advisory Committee members have specific committee assignments* 

Key: 0 = not involved 

1 = unfavorable involvement 

2 = favorable involvement 



XIV. EVALUATION OF COMMUNITY INVOLVEMENT MANAGEMENT PROCESS 
The Project Director's responsibility to the community is largely one of 
providing supportive services • Objective 4.3.2 requires 90% (of the local 
and central advisory) committee members responding that secretarial 
assistance, supplies and A-V equipment was adequate. Table XXI, pq.3B, indicates 
that criterion was met. In addition, the staff was required (Objective 4.3,3) 
to prepare and disseminate Invitations to parents concerning times, agendas, 
and places of project and related events. Mailing lists confirm this wos dono. 
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However, attempts to identify input from. the community in reports 
dealing with project planning, dissemination, needs assessment, and 
evaluation (Objective 4.3.5) were fruitless. Table XXIV confirms thai 
members of local and central committees felt they were involved although 
their input was not clearly defined in said reports. The dissemination 
plan (Objective 4,3.7) has been delineated and put into effect this fall. 
A questionnaire was sent to all recipients of disseminated materials and 
the results of that survey will be' used to evaluate the plan and to make 
revisions if deemed necessary. These results of this questionnaire have 
been used to revise and up-date mailing lists. This criterion is being met. 

The utilization of the expertise of the advisory committees is reported 
in TableXXIV(Objective 4.3.8) and, as indicated before, with the exception 
of establishing priorities where an only 75% favorable response was 
obtained, 80% or more responded favorably to their involvement in Nolde 
activities. 

Objectives 4.3.9 and 4.3.10 require input from the local ad^/jsory 
committees. There is no evidence available to substantiate that pither 
of these criteria were met. 

XV. SUMMARY AND CONCLUSIONS 

There is no doubt in the minds of the evaluators that the Nolde State 
Forest Project continues to demonstrate commendable progress. The 
Project Director, Mr. Louis Ritrovato, evidences strong leadership and is 
backed up by an interested and dedicated staff. Almost all performance 
criteria are being exceeded. Only a very few objectives are not being 
accomplished. 

The major problem confronting the project is lack of staff. The very 
recent addition of a new secretary should reduce the staggering burden 
of detail work for the project secretary. However, the evaluators do not 
understand why it took four months to replace a secretary who left and whos 
leaving date was known at her time of hiring. 



Additionally, the project lacks a staff member who could devote the 
vast majority of his time to curriculum development. The materials 
developed this summer now have been tested in the classroom by experi- 
mental teachers and fresh input is available. These materials and activities 
which are constantly being developed must now be revised with necessary 
coordination and integration. 

Additional staff is needed to help the Director and to meet expanding 
requests for use of project activities, especially over weekends. 
Currently, project coordinators put in a fifty hour plus week. The Project 
Director's week is much longer. Requests for in-service have grown to 
the point where twelve requests had to be turned down for lack of staff. 
Given the importance of environmental education, these requests should 
not go unanswered. Three full-time educational staff members plus one 
full-time teaching naturalist are not sufficient to run a project of this size. 
The project is successful because the staff is producing. The only thing 
holding the project back from an even greater accomplishment is the lack 
of staff. Additional money should be allocated to meet these staff needs. 

There are two areas which were criticized in the Interim Report. First, 
concern was expressed about sufficient in-service training being given 
experimental teachers. In-service training consisted of two one-day 
programs with considerable time being expended to interpret details . Many 
teachers entered this program with little or no training in environmental 
education. One winter experimental teacher volunteered to the evaluator 
that part of her motivation came from a desire to increase her expertise in 
this area. An effort should be made to allocate more time to in-service 
training prior to each program's inception. In-service training has been 
provided for those teachers requesting it. However, many teachers arc 
typically reluctant to request or lack the time to undergo it. In cooperation 
with Penn State University an Environmental Education Program, graduate 
level, was held at Nolde over the summer. It would be desirable to be able 
to work out logistics, inc.ludinci financial, that would enable all project 



ERIC 



-47- 



teachers to participate in this or similar six-week sessions. This past 
summer a few project t.^achers paid their way to the session. 

Second, the evaluators expressed concern about the staff's ability to 
communicate activities. The final reports for experimental schools were 
helpful as were the logs submitted by the secondary coordinator. The 
evaluators have sought to further increase their sources of information by 
developing a form for the coordinators to use when critical incidences occur. 
A similar form, developed by ERANDA, has worked well with project teaclv.rs. 
The elementary coordinator should also maintain such a log. 

In general, the project has been successful in meeting or exceeding its 
behavioral objectives in the instructional, staff development and materials 
development components. Cross-indexing by text and tables further substan- 
tiates this. However, there is one area where the project is consistently not 
meeting stated objectives. The area of community development falls short 
primarily in relation to the creation, continuation and integration of local and 
central advisory committees. These committees are important as they provide 
direct liaison with the community, its people, agencies and government. While 
their function is not one of decision-making, their feedback should provide 
valuable advisory assistance in terms of establishing priorities and indicating 
needs in the project. This potential source is not being effectively tapped. 

Although not formally part of the evaluation desigr^, the evaluators feel 
there is an area in which the project is excelling. The facilities at Nolde State 
Park are being utilized in many diversified ways. Activities include, among 
others, research, in-service, project description history, and environmental 
studies. This indicates especially effective use of the Park, in spite of a 
limited staff. 

The project is significantly improving the environmental knowledge of the 
participating students as well as changing their attitudes, in a more positive 
direction, towards the environment. Most often this growth is superior to 
similar-type students not participating in the project. These changes are 
occurring more in the urban groupings, where they are probably needed most. 
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To summarize,, the Nolde State Forest Project has been extremely 
successful in utilizing to the fullest its expertise, staff and facilities. 
With the few exceptions cited, it has met its stated objectives at levels 
consistently above what was expected. 
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